Python Job: Data Engineer

Job added on

Company

Restive Tech
Australia

Location

Remote Position
(From Everywhere/No Office Location)

Job type

Full-Time

Python Job Details

ABOUT THE ROLE:

As a member of the Insights Team, you will be involved in developing data collection and analytics initiatives to get valuable customer, product, and operational insights. You will leverage your extensive expertise in data handling and curation to deliver data-driven support to our users and enhance the organisation’s data capabilities.

You’ll be responsible for building intelligent domains using industry-leading tools and cloud technologies such as Azure DevOps, Azure Data Factory, and Databricks.

REQUIREMENTS:

  • Extensive experience, knowledge, and skills in Data Engineering, including BI/software development such as ELT/ETL, data extraction, and manipulation within Data Lake/Data Warehouse environments.
  • Demonstrated expertise in data modeling, analysis, and profiling.
  • Proven track record of working across diverse data domains.
  • Strong focus on continuous improvement and performance optimization practices, ensuring high levels of performance, availability, and data integrity.
  • Familiarity with Agile methodologies and experience working within an Agile environment.
  • Proficiency in applying DevOps practices, SDLC, and CI/CD principles to build automated pipelines and facilitate deployment.
  • Deep understanding of data engineering practices and proficient in big data technologies.
  • Hands-on experience with SQL and its Big Data variants (Hive-QL, Snowflake ANSI, Redshift SQL).
  • Proficient in Python and Spark, including one or more of its APIs (PySpark, Spark SQL, Scala), as well as Bash/Shell scripting.
  • Familiarity with Source code control systems such as GitHub.
  • Knowledge and exposure to cloud-based Big Data warehouses, including RedShift, Snowflake, Databricks, etc.
  • Experience with UNIX command-line tools.

ABOUT RESTIVE:

A little about us...... we're an Aussie Founder led tech consultancy with a diverse range of services from thought leadership, strategy, design, development and implementation.

Check us out here: https://www.restivetech.com.au/

Our clients are typically iconic Australian brands like Coles, JB Hi-Fi, Sportsbet, Liberty Financial and Tyro Payments. As a tech consultancy, we are able to support you with contract roles or a permanent position with Restive Tech. We have a diverse culture, with talented specialists that support our business and in turn we enable their career growth and individual wellbeing